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ABSTRACT 


The  transient  behavior  of  the  LMS  adaptive  filter  is  studied  when  configured  as  a 
canceller  operating  in  the  presence  of  a fixed  or  variable  complex  frequency  sine-wave 
signal  buried  in  white  noise.  For  a fixed  frequency  signal,  the  mean  weights  are 
shown  to  respond  to  signal  more  rapidly  than  to  noise  alone.  For  a chirped  signal,  a 
fixed  parameter  matrix  first-order  difference  equation  is  derived  for  the  mean  weights 
and  a closed-form  steady-state  solution  obtained.  The  transient  response  is  obtained 
as  a function  of  the  eigenvectors  and  eigenvalues  of  the  input  covariance  matrix.  Suf- 
ficient conditions  for  the  stability  of  the  transient  response  are  derived  and  an  upper 
bound  on  the  eigenvalues  obtained.  Finally,  the  mean-square  error  is  evaluated  when 
responding  to  a chirped  signal.  The  gain  coefficient  of  the  LMS  algorithm  is  determined 
that  minimizes  the  mean-square  error  for  chirped  signals  as  a function  of  chirp  rate 
and  signal  and  noise  powers. 

Y 

\ 


“■  


I INTRODUCTION 


The  LMS  adaptive  filter  has  been  proposed  and  used  in  situations  where  the  statistics 
of  the  input  processes  are  unknown  or  partially  known  The  structure  of  the  LMS 

algorithm  for  adjusting  the  weights  of  the  adaptive  filter  requires  quadratic  operations 
on  stochastic  input  data  which,  in  general,  are  difficult  to  analyze.  Under  the 
assumption  of  statistically  independent  data  samples,  the  mean  weight  vector  and  the 
covariance  of  the  weight  fluctuations  have  been  obtained  for  a variety  of  stationary  input 


data  statistics 


[1-U| 


Special  configurations  of  the  LMS  algorithm,  such  as  noise 


cancelling  ^ line  enhancing^’  ^ spectral  analysis,  ^ and  single  fre- 

quency line  detection^  ^ , have  been  studied  in  considerable  detail.  The  special 
characteristics  of  the  LMS  filter  configuration  have  been  used  to  aid  in  the  analysis 
of  the  behavior  of  the  algorithm. 


The  purpose  of  this  paper  is  to  present  some  exact  analytical  results  for  the  LMS 
algorithm  configured  as  an  adaptive  noise  canceller  when  the  input  process  consists  of 
a chirped  sine  wave  in  additive  stationary  white  noise.  Although  some  previous  work 
on  LMS  algorithm  behavior  in  a non-stationarv  environment  has  been  published 
only  one  has  investigated  the  response  of  the  LMS  algorithm  to  chirped  sinusoids 
in  \>hite  noise.  The  analysis  is  performed  by  assuming  the  chirping  is  slow  enough 
so  that  a quasi-stationary  model  for  the  mean  weights  can  be  used.  In  this  paper, 
exact  analytical  results  are  obtained  for  the  chirped  sinusoidal  signal  with  arbitrary 
chirp  rate.  Since  the  adaptive  cancelling  of  dynamic  signals  is  a key  element  in 
cancelling,  line  enhancing  and  frequency  tracking,  the  analytical  results  for  the  above 
model  have  wide  applicability. 


Two  principal  results  of  this  paper  are 

1.  A closed  form  analytical  expression  for  the  LMS  mean  weights  in  a dynamic 
signal  environment. 

2.  Explicit  trade-off  results  between  filter  parameters,  weight  variances, 
mean-square-error,  and  input  signal  dynamics. 

The  latter  result  is  of  special  interest  since  it  shows  explicitly  the  compromise 
between  fast  adaptation  in  order  to  respond  to  variations  in  the  input  statistics  and 
slow  adaptation  to  reduce  the  fluctuations  in  the  adaptation  process  itself. 
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For  the  narrowband  signal  in  white-noise  case,  the  configuration  shown  in  Figure  1 

* 

can  be  used  to  model  the  above  LMS  algorithm  functions. 


With  reference  to  Figure  1, 

o 

j(cj  nAt  + w(nAt)  y2  +0) 
d(n)  = <r  e ° + n.  (nAt) 
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A is  chosen  so  that  n^nAt)  and  n^nAt  -A)  are  un -correlated.  On  the  other  hand, 


because  the  desired  signal  is  a chirped  sine-wave,  it  decorrelates  more  slowly  than 
the  noise. 


II.  DYNAMIC  MODEL  FOR  THE  INPUTS 


The  algorithm  tor  changing  the  complex  weights  of  the  adaptive  filter  is  given  by  ^ 

W(n+1)  = W(n>  + p.  [d(n)  - X^\n)  W(n)]  X*(n) 

= \V(n)  > p [d(n)  X*(n)  - X*tn>  X^(n)  W(ni]  (,1) 

where  \V(n)  * filter  weight  vector  at  time  n,  d(n)  = desired  signal,  X(n>  = observed 
data  vector  at  time  n,  and  where  * and  T denote  complex  conjugate  and  vector 
transpose  respectively. 

Averaging  equation  (1)  and  assuming  1)  the  data  sequence  Xpi)  is  statisticallv  mde- 
U-Al 

pendent  over  time  and  2)  the  present  weight  vector  and  the  present  data  vector  are 
statistically  independent'11!  yields 

EtW(n«-l)l  * E(W\n\l  - R^fn)  E |W(n)|]  (2) 

where  R ^(n)  = E [d(n>X*(n)|,  R ;n)  = E [x*(n)X^  in)]. 

• 

In  practice  the  algorithm  sampling  interval  (At)  is  usually  chosen  to  correspond  to 
the  delay  3 between  the  taps  of  the  adaptive  filter.  Furthermore  (At)  is  usually 
chosen  to  correspond  to  independent  samples  of  the  noisy  data.  Hence  the  delay  A 
is  chosen  to  be  integer  multiples  of  (At)  in  order  for  the  noises  in  the  two  inputs 
to  be  un-co rrelated.  On  the  other  hand,  the  longer  that  A is  chosen,  the  less 
correlated  is  the  signal  component.  Thus  choice  of  A 3 3 is  the  best  that  can  be 
accomplished.  * 

When  the  input  consists  of  a complex  sine-wave  with  linearly- varying  frequency  in 
additive  noise, 


j(w  t *wt“  2 +•  O) 

d(t)  = eg  e ° + n(t)  (3) 


•Other  integer  values  of  3 for  the  bulk  delay  A can  be  studied  using  the  subse- 
quent analysis  and  the  results  show  that  A = s yields  the  hest  filter  performance. 
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where  Js“  * signal  power,  = signal  frequency,  Jj  = rate  of  change  of  signal 
frequency,  o = random  phase  of  signal  and  the  noise  is  independent  of  the  signal 

O 

with  noise  power  on“  and  normalized  covariance  matrix  G,  then 


Rvx(nl  = o-  “ G + crg“  D(n)  D*(n) 1 

(4) 

= V D'm 
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with  M = number  of  complex  weights. 
Using  Eqs.  (41  and  (51  in  Eq.  (2)  yields 


E(W(n+ll]  = 


[ - * (V  G + ^s” 


D(n)D*(n) 


E(\V(n)  1 + p cr  “D(nl 


For  white  noise,  G = 1.  Define 


a “ 

M(nl  = I + D(nlD*(nlT 

j “ 

n 


(8) 


For  any  n,  the  eigenvectors  of  M(nl  are  the  vector  D(nl  and  any  set  of  (M-ll  vectors 
orthogonal  to  D(n).  The  associated  eigenvalues  are 


\ - “4 

<r  “ 

n 
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Note  that  the  eigenvalues  are  independent  of  time.  All  the  time  variations  in  M(n) 
are  contained  in  the  eigenvectors.  This  special  property  of  M(n)  is  exploited  to 
obtain  closed  form  solutions  for  Eq.  (7). 


III.  SOLUTION  OF  EQ  (7)  FOR  THE  MEAN  WEIGHT  BEHAVIOR 


Since  M(n)  is  Hermitian,  there  exists  a unitary  transformation  P(n)  which  diagonalizes 
M(n)  for  each  n, 

P(n)  M(n)  P_1(n)  = * = Diag  (X^  \2  (10) 

The  X.  are  not  functions  of  n.  Due  to  the  special  form  of  D(n), 


DT(n  = V11  DT(o) 


(ID 


where 

V = Diag  (a,  a2,  , a^1),  a = ejw<S 

Also  P(n)  can  be  written  in  terms  of  the  eigenvectors  of  M(n), 
P+(n)  = —==.  fD(n) , R.(n),  ...  R jfa)"] 

;m  L j 


(12) 


where+  = conjugate  transpose  and  R^,  R2  ' • ' RM-1  are  mutua^^  ortho-normal 
vectors,  also  orthogonal  to  D(n)  for  each  a.  Using  Eq.  (11), 

P(n)  = P(o)  (V*)n  (13) 

Using  Eqs.  (8),  (II)  and  (13)  and  defining  Z(n)  = P(n)  E(W(n)],  Eq.  (7)  can  be  written 
in  terms  of  Z only  as 

Z(n+1)  = P(0)  V*  P_1(0)  [l-pjLcrn2A^]  Z(n)  + per.2  P(0)  V*  D(0)  (1-i) 


Since  Eq.  (14)  is  a constant  coefficient  linear  difference  equation,  with  P(0)  = P , it 


follows  that 


jp  V*  P -1 
o o 


[‘--nM 


n . m-1 

+ p<r  2 Y tp  V*  P _1  |"i~hct  2xl  P 
p s / j j o o |_  r n J o 

m=l  v 


V*  D(0) 


Before  investigating  the  general  case  of  Eq.  (15),  consider  the  fixed  frequency 
sinusoid  signal  case  when  V = I and  Eq.  (15)  simplifies  to 


- z<0>  + hwT  1 s 


where  ST  = (\7m^  0,  0,  ...  0).  Expressing  the  matrix  sum  in  closed  form 


a 2 -1 

Z(n)  = [l-po^x]  Z(0)  S [i  - (I-pcrn2X  )n] 


Thus,  using  Eq.  (9),  the  components  of  Z(n)  are  given  by 


r / 2 2\l"  r 12  2(1°) 

' t1  - * M°s ')]  zl<°>  +—  /i  1 * 1 - *{'*  )J  | 

a / n \ ™ 


r 2ln 
Vn)  * L1  ' ‘“'n  J zj( 


j = 2,3 M 
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9 2 

Hence,  for  p(on“+M  crg  ) <1,  the  response  of  the  weights  to  the  signal  frequency  is 
more  rapid  than  to  any  other  frequency.  If  Zj(0)  =0,  j = 1,2, ...  M,  then  z^n)  is  the 
only  response. 


zx(n) 


v/mct2  /a 
s / n 

1 + Mff  “/  or 
s / n 


+ Mj‘ 
s 


(19) 


Transforming  back  to  the  original  coordinate  system, 


E(W(n)l  = P "1  Z(n)  = 


9 / 9 

ff  “ / cr 
s / s 

1 + Mff  2/a  “ | 
s / n ' 


( 

r 1 

n) 

1- 

1 -ala2  + Mff  2) 

1 

\ n s / 

l 

( 

) 

D(0) 


(20) 


Hence,  the  mean  weights  are  scaled  versions  of  the  desired  signal  response.  From 
Eq.  (18),  note  that  the  time  it  takes  the  filter  to  adapt  from  zero  initial  conditions  and 
learn  the  signal  is  less  than  the  time  required  to  forget  the  signal  if  it  disappears. 
That  is,  from  Eq  (19),  if  z.(0)  = 0,  j = 1,2,  ...  M,  signal  response  time  is  propor- 

9 9 1 

tional  to  1 - p.(ff  “+Mff  “).  If  the  signal  suddenly  disappears  so  that  z.^O)  t 0,  then 
n $ *■ 

from  Eq.  (17)  with  ff  “ = 0,  the  decay  time  towards  z. (n)  = 0,  is  proportional  to 

9S  A 

1-pcr  “. 
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IV.  STEADY-STATE  WEIGHT  BEHAVIOR 


The  explicit  solution  of  Eq.  (14)  requires  evaluation  of  the  eigenvalues  and  eigenvectors 

of  the  matrix  operator  in  brackets  in  Eq.  (15)  (see  Appendix  I).  However,  the  steady- 

state  solution  to  Eq.  (14)  is  obtainable  without  knowledge  of  the  eigenvalues.  In  Eq.  (15), 

set  Z(0)  = 0 (zero  initial  conditions)  without  loss  of  generality.  Let  Q be  the  matrix  of 

eigenvectors  of  the  matrix  P V*P  _1  jl-pcr  2\j  and  A = Diag  (A  , , \n  . . . A ) be 

o o ( n j 12  m 

the  matrix  of  eigenvalues.  Thus 

n m ^ 

Z(n)  = ti(7g2  ^2  [Q  AQ_1]  PQV*D(o) 
m=l 

= ^s2  Q(  2 ‘'p"1  Po  V*  D(o)  (21) 

\m=0  / 

But 

n-1 

Y xm  = Dia8 

m=0 

for  | A . | < l for  all  i,  and 

-'m  - «-  a,'1 

m=0 


1-  A. 


1-A 


1-A« 


1-A 


m 


1-A 


m 


(22) 
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In  Appendix  It  it  is  shown  that  A . <1,  for  all  i if  0 < \i  (a  +M  cr  ) < 2.  Let  Z = 
« . ill  ns  s s 

Z(n).  Then,  using  Eq.  (23),  Eq.  (21)  becomes 

n oo 

Zss  = ^as2  Q"1  Po  V*  D(o) 


Po 

^ s o 

[V- 

• (1  - p*n2>  l] 

_1  D(0) 

1 +JXCT  2 D + 

r s o 

[v  - (W<7n2)  i] 

_1  D(0) 

(24) 


The  steady-state  weights  are  the  quantities  of  interest.  Note  that  they  will  be  time 
varying,  even  though  the  adaptive  filter  is  in  steady-state.  Here,  steady-state  implies 
that  the  adaptive  filter  has  converged,  interpreted  as  the  convergence  of  the  trans- 
formed weight  vector  Z(n).  However,  the  filter  has  converged  to  a time-varying 

solution  to  follow  the  time-varying,  non- stationary  input  signal.  Thus,  when  Z is 

ss 

inverse  transformed  back  to  the  mean  value  of  the  weights,  the  transform  is  via  the 
eigenvectors  of  the  input  covariance  matrix,  which  are  time-varying.  Let  E[W  (n)] 
denote  the  mean  value  of  the  steady-state  weights  at  time  n. 


E[wss(n)]  - P-V)  Zss 

-1 

_ ^s2  [v-^-^n2)  i]  °(n) 
_ 


(25) 


1+^s2 


£ 


As  a check,  Eq.  (25)  can  be  compared  with  the  steady-state  value  of  the  weights  in 
the  stationary  case,  i.  e. , with  w - 0.  For  that  case  V = I,  D(n)  = D(0)  and 


cr 

n 


(26) 


which  agrees  with  Eq.  (20)  when  n— •» . 
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Computer  evaluation  of  the  steady-state  mean  weights  in  Eq.  (25)  is  presented  in 

9 

Figures  2-5  for  £ * 5 Hz/seo"  and  in  Figure  6-9  for  f = 1.25  Hz/sec“.  In  all  cases, 
the  filter  has  128  tups  with  p = .1  . The  signal-to-noise  ratios  are  varied  from 
10  to  10  . The  figures  display  the  magnitude  and  phase  of  the  weights  across  the 

filter.  Three  interesting  phenomena  are  displayed  in  these  figures: 

1.  As  the  signal-to-noise  ratio  decreases,  the  adaptive  filter  uses  more 
of  the  taps  but  at  lower  amplitudes, 

2.  The  tap  phases  follow  the  movement  of  the  linearly  varying  frequency 
input, 

3.  As  f increases,  the  taps  at  the  far  end  of  the  line  contribute  relatively 
less  to  the  filter  output  than  those  taps  at  the  beginning  of  the  line. 

These  phenomena  can  be  explained  as  follows: 

1.  The  two  sources  of  randomness  that  contribute  to  the  filter  output  moan- 
square-error,  are  input  noise  and  algorithm  noise  (weight  misadjustment).  The 
contribution  of  the  input  noise  to  the  mean  square  error  decreases  linearly 
with  the  number  of  taps  whereas  the  algorithm  noise  increases  linearly 
with  the  number  of  taps.  Thus,  at  high  input  signal-to-noise  ratios,  the 
algorithm  noise  is  the  limiting  factor  and  few  taps  are  needed.  At  low 
input  signal-to-noise  ratios,  input  noise  is  the  limiting  factor  and  a 
large  number  of  taps  are  needed  in  ord<’r  to  reject  the  input  noise. 

Eventually  algorithm  noise  becomes  the  significant  factor. 

2.  The  figures  show  only  the  mean  values  of  the  steady-state  weights  at  a 
particular  instant  of  time  after  the  filter  has  converged.  Hence,  there 
should  be  a quadratic  phase  shift  with  the  tap  number  in  accordance  with 
D(n)  in  Eq.  (6).  Comparison  of  Figure  3-5  with  Figure  2 and  Figure  7-9 
with  Figure  6 shows  that  the  steady-state  weights  do  display  this  behavior. 

3.  The  filter  trades  off  coherent  integration  (proportional  to  the  number  of 
significantly  non-zero  weights)  against  the  phase  changes  required  at  each 
tap  to  follow  the  chirped  signal.  Since  the  phase  change  required  at  each 
iteration  for  each  tap  grows  linearly  with  tap  numlier  (entries  in  V), 
weights  at  the  tar  end  ot  the  line  must  make  large  phase  changes  m com- 
parison to  those  at  the  beginning  of  the  line.  Note  that  the  quadratic 
phase  correction  along  the  line,  D(o),  is  independent  of  time.  Hence, 

13 


once  the  filter  estimates  f and  f,  it  knows  D(o)  and  can  introduce  these 
phase  corrections  statically.  On  the  other  hand,  the  filter  must  change 
phase  by  the  entries  in  V at  each  iteration.  Large  phase  changes  are 
most  easily  made  when  the  magnitude  of  the  weights  are  small.  In  Fig- 
ure  3-5,  AO  * u >6“  = 2ff/lOM  radians  and  in  Figure  7-9,  A©  = 2t/40  M 
radians.  Hence  the  M^1  weight  has  to  change  by  tr/5  and  rr/20  radians, 
respectively.  In  order  to  accommodate  these  large  phase  changes  for  the 
same  algorithm  step  size,  the  weights  of  the  far  end  of  the  line  must  be 
smaller  than  those  at  the  beginning  of  the  line.  As  f decreases,  the  dif- 
ference in  phase  changes  at  the  two  ends  of  the  line  decreases  and  the  filter 
can  make  use  of  significant  values  for  the  weights  at  the  far  end  of  the  line. 
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V.  THE  MEAN  SQUARE  ERROR  IN  STEADY-STATE 


Then 

E[wT(n>  X(n)  W*(n)  X*(n>]  = E[\V+(n>]  E^X*(n)  XT(n)]  E^Vfn)] 

+ E^+(n)  X*(n)  XT  fn)  t,(n)]  (31) 

The  first  term  in  Eq.  (31)  is  known.  The  second  term  in  Eq.  (31)  is 

E^f+tn)  X*(n)  XT(n)  j (n)j  = E jj:  *(n)  E [x*(n)  XT(n)J  j (n)J 

= (v  +<Tn2)E[£+^f(n'] 

/ 2 ° \ ° 

* a“  cr  “KM  a “ , (32) 

\ s n / w ' 

assuming  the  weight  fluctuations  are  stationary,  uneorrelated  from  tap-to-tap,  and 
have  the  same  variance  <7  2 for  each  individual  weight.  Thus,  using  Eqs.  (31)  and 
(32)  in  Eq.  (28)  yields 


2 ! 

<> 

) ■+• 

'■>  o 

E 

|e(n)|  | 

= <j  “ 

s 

1 - EjW(n)|  D(n) 

“ +•  <7  “ 

n 

1 + 


E j\V(n)j  +E  |\V(n) ; 


* M 


(o2^2) 

\ s n / 


2 - (M+l)  (nr 


(33) 


\»  here  or  ^ has  been  approximated  by  the  weight  fluctuations  under  noise  alone  ‘ ^ 
The  first  term  in  Eq.  (33)  represents  the  error  in  estimating  the  chirped  complex 
exponential  signal.  The  second  term  is  the  sum  of  the  noise  power  in  the  reference 
channel  and  the  noise  power  passed  by  the  mean  weights  of  the  adaptive  filter.  The 
last  term  represents  the  weight  misadjustment  variance  multiplied  by  the  total  input 
power. 


Eq.  (33), normalized  by  the  total  input  power,  has  been  evaluated  as  a function  of 
for  M - 18,  32,  64,  signal-to-noise  ratios  of  0 and  *10  dB  and  various  In 

Figure  10-15,  the  trade-off  can  be  seen  between  static  and  dynamic  contributions  to 
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2 

total  mean-square  error.  In  each  case,  there  is > an and  ^ght 

^ ^ f 
misadiustment  noise.  Comparis  performance.  On  the  other  hand,  tor 

slgnal-to-noise  ratios  ,mpr<^  see„  that  the  normalised  man  square 

suiilcientiy  larged  and  SNR  - « ^ ^ ^ ^ welght  mis-ad)ustment 

performance  is  obtained  tor  longer  alters  (e.g. 

, Flmre  10-i5  that  the  optimum  selection  of  pc„2 . *»  * 

It  can  be  seen  from  Figu  same  manner  asa>  <5  . As  w S 

teagd,  M and  signal-to-»oise  ^ „ achitv,  the  minimum  mean-square 

increases,  a larger  value  otpen  ™ ,„creases  asig".  ™e  filter 

However  this  minimum  mean  q i.e  a larger 

error.  However  ui  hence  must  make  a ia 

- -r - * - — — 


CONCLUSIONS 


A mathematical  model  of  the  mean  weight  behavior  for  the  LMS  adaptive  filter  has 
been  presented  when  the  filter  is  operating  as  a single  frequency  line  enhancer  and 
line  follower.  For  a fixed  frequency  complex  sine  wave  input,  the  LMS  filter  weights 
have  been  shown  to  respond  to  signal  and  noise  more  rapidly  than  to  noise  alone.  This 
implies  that  the  filter  learns  more  quickly  that  a line  has  appeared  than  it  is  able  to 
forget  that  the  line  is  turned  off. 

When  the  signal  frequency  is  changing  linearly  with  time,  the  mathematical  model 
predicts  a time-varying  behavior  of  the  filter  mean  weights  necessary  to  respond  to 
the  changing  signal  frequency.  As  the  chirp  rate  increases,  the  filter  reduces  the 
relative  amplitudes  of  the  weights  so  as  to  adjust  the  effective  filter  length  to  optimally 
match  the  properties  of  the  signal.  That  is,  for  example,  suppose  the  filter  designer 
selects  a filter  of  length  M = M^«  However,  the  chirp  rate  is  sufficiently  large  so  that 
the  change  in  signal  frequency,  between  algorithm  Iterations,  is  greater  than  the  band- 
width of  the  filter.  Then,  the  L.MS  algorithm  will  automatically  scale  the  amplitude  of 
its  weights  to  have  an  effective  length  M„,  M0  <M  such  that  the  signal  remains 
inside  the  adaptive  filter  between  iterations.  As  long  as  the  signal  frequency  lies 
within  the  LMS  filter  bandwidth,  the  LMS  filter  algorithm  can  track  the  changing  fre- 
quency since  there  is  sufficient  correlation  between  the  two  inputs  to  drive  the  LMS 
algorithm  in  tire  correct  direction. 


The  mathematical  model  of  the  mean  weight  behavior  has  been  used  for  selecting  m, 
the  adaptation  coefficient  of  the  algorithm,  for  a wide  variety  of  signal  and  noise 
parameters.  The  criteria  of  optimality  was  that  of  minimizing  the  filter  output  mean 
square  error,  since  the  error  is  the  driving  term  in  the  weight  adjustment  algorithm. 
(An  alternate  criteria,  based  on  a signal  detection  model  using  the  filter  output,  could 
also  be  a candidate  for  optimization.!  A set  of  curves  of  normalized  mean-square 
error  as  a function  of  signal- to- noise  ratio  and  chirp  rate  were  obtained.  From  these 
curves,  the  following  observations  can  be  made: 

•> 

1.  For  a given  signal- to- noise  ratio  and  chirp  rate  - 6“ . there  exists  an 
optimum  selection  of  u that  minimizes  the  overall  mean  square  error. 

2.  For  slowly  changing  signal  frequency,  the  mean  square  error  exhibits  a 
relatively  broad  minimum.  This  is  because  a large  range  of  ue  “ Wjll 
follow  the  slowly  changing  signal  frequency  yet  allow  sufficient  smoothing 
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so  as  to  keep  the  weight  misadjustment  noise  below  a certain  minimum. 

On  the  other  hand,  for  a rapidly  moving  signal  frequency,  mismatch  in 

O 

selection  of  “ can  cause  a significant  increase  in  mean-square  error  as 
compared  to  the  optimum  selection  of  pon“. 

3.  As  a system  designer,  one  would  choose  a (jian“  that  would  be  optimum  for 
the  fastest  chirp  rate  expected.  The  mean  square  error  would  always  be 
upperbounded  by  the  mean  square  error  for  the  fastest  chirp  rate. 
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APPENDIX  I.  EIGENVALUES  OF  TRANSFORMATION  MATRIX 


In  order  to  easily  evaluate  the  mth  power  of  a matrix,  the  eigenvalues  of  the  matrix 
are  needed.  The  matrix  in  brackets  in  Eq.  (15)  is 


P V*  P 
o o 


= PQ  v*  [ Pn_1  - jxa  2 P _1  \1 
o L o 'no  J 

= PQ  V*  [l  - pan2  M(0)]  P^1 


(I-D 


Since  PQ  premultiplies  and  P0_1  post-multiplies  R=V*  [l-pc^2  M(0)1,  it  is  only  neces- 
sary to  find  the  eigenvalues,  A ,.  of  R.  The  eigenvalues  of  R satisfy: 


r 

V* 

I - n (o_2  I + a 2 D D +) 

- AI 

\n  s o o / 

U J 

(1  - no ■ *)  I - AV  - pa, 


,2  D D + 
> o o 


= 0 


(1-2) 


where 


Dq  = D(0)  and  | j denotes  the  determinant. 

Because  of  the  simple  structure  to  R,  an  expression  for  the  eigenvalues  can  be  found. 
Given  a matrix  of  the  form  B = A + a^b^  where  a^and  fc^are  column  vectors, 

|B|  - Wjl+b^A^aJ  (I.3) 
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Thus,  with  A = (1  - lux  “)  I - A V , a.  = D = b.  , 
' r n l o 1 


(l-Vi-crn“  ) !-  AV  -M.tr/  Qn  D + 


s o o 


L>iag/ 


9\ 

1 

> 

i 

i 

bC 

f r, 

t 

a 

a 

2 + 
.1  - ii‘T  D 
1 s o 


M 


(1_viV)  a“_A  (l“»*an  ) aH"A'  °f 


‘ • •‘A.3] 


M 


1 - ML(J 


. 


2 a"\  I 
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m-1  ' rn  1 


>1M  | V ■»  v ,m 
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The  term  in  brackets  yields  an  M’tli  order  polynomial  in  \ for  which  there  is  no 

general  analytic  solution.  Eq.  (1-4)  must  be  programmed  on  a digital  computer  for 
o 2 

various  g.,  a cr ^ and  a. 

Although  explicit  values  of  A are  not  obtainable,  a simple  upper  bound  on  the  eigen- 
values of  A and  hence  on  the  transient  behavior  of  Eq.  i21)  are  obtainable.  This 
upper  bound  on  the  eigenvalues  is  useful  since  it  is  an  indication  of  the  slowest  possible 
response  of  the  system. 


Let  u be  an  eigenvector  of  the  matrix  in  Eq.  (1-1)  with  associated  eigenvalue, 

T r 

Then,  with  irHi  = 1,  ami  u - u,u„  ...  u 
- 12  m 


A .u 
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P V*  P _1  (i-u.r  ~\)  u 
o o \ r n / — 


(1-5) 


Now , 
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Using  Pq_1  = Pq+  and  V+  = V-1 
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Let  q = V 
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< 1 and  p = 1-Q  = 
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Similarly 


A = P 
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Eqs.  (1-8)  and  (1-9)  lead  to  the  following  bounds: 
CD  Ifp(^n2  +M(7g2)  <,  1,  assuming  crj*  / 0 


(1-7) 


(1-8) 


(1-9) 
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(2)  If  p(cr  “ + Mff _2)>lbut  pa  “ £ 1,  then  for  a “ 4 0 
\ **  s ' n n 
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* i- 


< 1 for  ^Mcrs2  S 2(l-^crn2) 


and 


Sit 


(a  2+Ma  2) 
\ n s / 


for  (jlMct  > 2 (1-p.a  “) 


In  the  latter  case,  j A . j 2 < i if  l1  (°n'*+M(Ts2)  < 2 
(3  If  p Jn“  > I then 
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Ai(2s|1-^(<Tn2+Mos2) 


(1-11) 


(1-12) 


and 


'<  1 


A . < 1 Is 


Combining  these,  it  can  be  seen  that  A . < 1 if  ja.  (cr  “ + Mcr  “ ) <2.  Since 

I i|  \ n s / / o 1 11  o\ 

the  condition  for  existence  of  a steady  state  mean  weight  vector,  p |an“  + M<r  “j  < 2 is 

a sufficient  condition  for  a steady  state  solution.  It  is  interesting  to  note  that  the  bound 


on 


A, 


in  each  case  is  just  the  magnitude  of  the  largest  eigenvalue  in  the  stationary 

9 9 


frequency  case,  with  a 


a ',  p and  M unchanged.  Further 
s 


*K2rtv)<2 


is  the  condition  for  the  convergence  of  the  adaptive  canceller  in  the  fixed  sinusoid 
case.  This  leads  to  the  surprising  conclusion  that  if  the  mean  weight  vector  achieves 

O O 

a steady  state  value  in  the  stationary  case  for  given  cr  , <j  “,  M and  p,  then  a steady 

b II 

state  solution  will  exist  for  those  parameter  values  regardless  of  the  rate  of  change 
of  frequency. 
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A more  direct  result  for  convergence  can  be  obtained  as  shown  below.  This  latter 
approach  does  not  bound  the  eigenvalues  however. 


From  the  discussion  following  Eq.  (1-1)  it  is  seen  that  R is  similar  to  Q and  therefore 
has  the  same  eigenvalues.  From  ^18^, 


lim  y Am_1  = [I  - Af1 

n'°°  A 


if  the  L2  norm  of  A is  less  than  unity,  i.e. , A ||  < 1.  In  our  case,  R = A and 


R = 


= || V*  [l-HL(Tn2  (X)  ||  <||v- 


I-^X 


d-14) 


But  j|  V * ||  - 1 and  ]|I-ji<Tn  X||  can  be  evaluated  explicitly  as  the  square  root  of  the 
largest  eigenvalue  of  the  matrix  fl  - ^o^xj  * £l  - n^xj. 

But  o^2  xj  is  self-adjoint  and  has  only  two  distinct  eigenvalues. 

A1  ■ 1‘l‘(0,B*+Mff.2) 

A2  A3  = Si  = 1 ' I*0-2 


Hence 


and 


1 ' ^ (°n^  + Mog“  * <x 


(1-15) 


1 - m-o; 


n I 


<1 


26 


Mean  Square  Error 

2 

vs . ya 

n 


S/N(DB)  - 0.0 
FILTER  TAPS  - 16 


Mean  Square  Error 
2 

vs.  ua 

n 

S/N (DB)  - 0.0 

FILTER  TAPS  - 16 

- 

